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Art Unit: 2857 

DETAILED ACTION 

This action is responsive to the amendment filed December 28, 201 0. Claims 1 , 
5 and 10 have been amended. It is noted that on page 9 of Applicant's remarks, claim 
10 is indicated as amended, however, the status identifier indicates "previously 
presented". For examination purposes, claim 10 is treated as amended. Claims 13-18 
are new. Claims 1, 3, 5-6 and 10-18 are pending. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

1 . Claims 5-6 and 1 5-1 6 are rejected under 35 U.S.C. 1 02(b) as being anticipated 
by Geng in US Patent 6,028,672. 

Regarding claim 5, Geng teaches: 

A method for determining spatial co-ordinates of an object(s) (see three- 
dimensional surface profile measurement method, Abstract), comprising: 

- projecting a pattern (4) with known projection data onto an object (2) (see a 
projected rainbow color pattern, column 3 lines 44-47; see also see spatially varying 
color pattern, column 4 lines 52-53 and Fig. 9; see also spatially varying wavelength 
illumination, column 3 lines 34-36 and column 9 lines 17-18) by using a projector (see 
light projector, column 4 lines 13-16, column 6 lines 42-54, Figs. 1-2 and 9-10); 
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- creating two object images (8) with aid of two cameras (6) (see "Two color CCD 
cameras", column 3 lines 36-38; see also captured images, column 4 lines 30-55, 
column 5 lines 24-28; see also "...a pair of CCD cameras. ..The images, which contain 
both intensity and color...", column 4 lines 17-25, column 6 lines 59-61 and Fig. 1); 

- determining the spatial co-ordinates from the known projection data (see three- 
dimensional surface profile measurement method, Abstract) in a data processing unit 
(7) (see host computer, column 4 lines 25-26, column 5 lines 66-67 and Fig. 1) using a 
structured light approach (see structured light techniques, column 2 lines 7-10 and 
column 4 lines 57-58), in which the spatial co-ordinates of the object (2) are respectively 
determined using a known distance between the projector (s) and the camera (6) (see 
baseline, column 2 lines 1 6-1 7, column 7 lines 21 -22 and Fig. 1 ); 

- if the spatial co-ordinates are determined incorrectly, determining additional 
spatial co-ordinates of the object (2) are on a basis of the projection data and one of the 
object images (8, 9) by searching for corresponding image points (Si, S r ) in the object 
images (8, 9) (see Two Complementary Stereo Matching Schemes, column 7 line 15 - 
column 8 line 48) and a subsequent triangulation (see triangulation algorithm/principle, 
Abstract, column 3 lines 40-41 and Fig. 1 ; see also active triangulation, column 2 lines 
9-50) using a known distance between the two cameras (6) (see "the length of "base 
line", B, between two cameras is known", column 4 lines 35-37). 

Regarding claim 6, Geng teaches the limitations of claim 5 as indicated above. 
Further, Geng teaches: 
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The method as claimed in claim 5, wherein corresponding pixels (Si, S r ) are 
searched for along epipolar lines (16, 17) (see epipolar line, column 8 lines 20-48 and 
Fig. 5). 

Regarding claim 15, Geng teaches the limitations of claim 5 as indicated above. 
Further, Geng teaches: 

The method according to claim 5, wherein the pattern (4) is composed of stripes 
that are projected consecutively onto the object (2), with stripe widths of the pattern 
varying (see "producing a continuous spatially varying wavelength (rainbow-like color) 
illumination of the scene", column 3 lines 34-36; see also "the LVWF is a rectangular 
optical glass plate coated with gradually varying wavelengths of colors", column 6 lines 
1-3; see also "popular structured light techniques include light stripe method... active 
triangulation a beam of light is used to form a bright stripe on an object's surface", 
column 2 lines 8-17). 

Regarding claim 16, Geng teaches the limitations of claim 5 as indicated above. 
Further, Geng teaches: 

The method according to claim 5, wherein the two object images (8, 9) yield 
three-dimensional data (see "the proposed Rainbow Stereo 3D camera exploits a 
projected rainbow color pattern as unique landmarks of each pixel for correspondence 
registration... A simple and efficient 3D triangulation algorithm can be formulated to 
generate full frames of 3D images in high speed", column 3 lines 44-54). 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1,3,10-14 and 1 7-1 8 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Geng in US Patent 6,028,672, in view of Pettersen et al. 
2002/0048027. 

Regarding claim 1, Geng teaches: 

A device for determining spatial co-ordinates of an object(s), comprising: 

a projector (3) which projects onto the object (2) (see light projector, column 4 
lines 13-16, column 6 lines 42-54, Figs. 1-2 and 9-10; see object, column 4 lines 18-20 
and Figs. 1-2 and 9-10) a pattern (4) with known projection data (see spatially varying 
color pattern, column 4 lines 52-53 and Fig. 9; see also spatially varying wavelength 
illumination, column 3 lines 34-36 and column 9 lines 17-18); 

two cameras (6) which respectively create two object images (8, 9) of the pattern 
(4) projected onto the object (2) (see "...a pair of CCD cameras. ..The images, which 
contain both intensity and color...", column 2 lines 17-25, column 6 lines 59-61 and Fig. 
1), the pattern (4) containing encoded projection data (see "simple and elegant way to 
encode", column 4 lines 52-56; see also encodes, column 7 lines 34-38); 

a data processing unit (7) (see host computer, column 4 lines 25-26, column 5 
lines 66-67 and Fig. 1) connected downstream from the two cameras (6), which 
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determines spatial co-ordinates of the object (2) from the two object images (8, 9) and 
the known projection data (see three-dimensional surface profile measurement, 
Abstract) using a structured light approach (see structured light techniques, column 2 
lines 7-10 and column 4 lines 57-58), in which the spatial co-ordinates of the object (2) 
are determined using known distances between the projector (3) and the two cameras 
(6) (see baseline, column 2 lines 16-17, column 7 lines 21-22 and Fig. 1); and 

the data processing unit (7) determines additional spatial co-ordinates of the 
object (2) from the two object images (8, 9) by a triangulation method (see triangulation 
algorithm/principle, Abstract, column 3 lines 40-41 and Fig. 1 ; see also active 
triangulation, column 2 lines 9-50) using a known distance between the two cameras (6) 
(see "the length of "base line", B, between two cameras is known", column 4 lines 35- 
37). Further, Geng teaches "the colors of corresponding pixel in searching space is 
unique and distinguishable" (column 7 lines38-39) and "the search of matching points 
requires less complex computations" (column 8 lines 12-13). 

Geng differs from the claimed invention in that it does not explicitly teach 
redundant encoded projection data and searching for corresponding image points to 
problem areas in which an evaluation of the pattern images only produce an erroneous 
result. 

Pettersen et al. teaches a method and system, using cameras, for determination 
of relative position and/or orientation of objects by projecting a pattern (Abstract, [0001]- 
[0008] and Figs. 2, 5 & 6). Further, Pettersen et al. teaches "The method of calculation 
is bases on minimizing errors (least squares method) such that the redundant 
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information is used" (i.e. redundant encoded projection data and restricting the search 
for corresponding image points to problem areas in which an evaluation of the pattern 
images only produce an erroneous result, [0025] and Fig. 2]). Since Pettersen et al. 
teaches the redundant data is used to minimize errors, it would have been obvious to 
one of ordinary skill in the art to search the redundant information for corresponding 
image points to problem areas in which an evaluation of the pattern images produces 
an erroneous result in order to correct the result, thus minimizing errors. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Pettersen et al. with Geng 
because Pettersen et al. teaches the principle of coordinate determination from the 
imaging of a common point in two or more cameras and a means for coordinate 
measurement that gives full flexibility with respect to the number of cameras and other 
features ([0009]-[0014] and [0021]-[0022]), thereby improving the flexibility of the 
system. 

Regarding claim 3, Geng and Pettersen et al. teach the limitations of claim 1 as 
indicated above. Further, Geng teaches: 

The device as claimed in claim 1, wherein epipolar lines (16, 17) pass through a 
plurality of marks of the pattern (4) (see epipolar line, column 8 lines 20-48 and Fig. 5). 

Regarding claim 10, Geng teaches: 

A method for determining spatial co-ordinates of an object(s) (see three- 
dimensional surface profile measurement method, Abstract), comprising: 
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- projecting a pattern (4) with known projection data onto an object (2) (see a 
projected rainbow color pattern, column 3 lines 44-47; see also see spatially varying 
color pattern, column 4 lines 52-53 and Fig. 9; see also spatially varying wavelength 
illumination, column 3 lines 34-36 and column 9 lines 17-18) by using a projector (3) 
(see light projector, column 4 lines 13-16, column 6 lines 42-54, Figs. 1-2 and 9-10); 

- creating two object images (8, 9) with aid of two cameras (6) (see captured 
images, column 4 lines 30-55, column 5 lines 24-28; see also "...a pair of CCD 
cameras. ..The images, which contain both intensity and color...", column 2 lines 17-25, 
column 6 lines 59-61 and Fig. 1); 

- determining the spatial co-ordinates from the known projection data (see three- 
dimensional surface profile measurement method, Abstract) in a data processing unit 
(7) (see host computer, column 4 lines 25-26, column 5 lines 66-67 and Fig. 1) using a 
structured light approach (see structured light techniques, column 2 lines 7-10 and 
column 4 lines 57-58), in which the spatial co-ordinates of the object (2) are respectively 
determined using known distances between the projector (s) and the two cameras (6) 
(see baseline, column 2 lines 16-17, column 7 lines 21-22 and Fig. 1); 

- if the spatial co-ordinates are determined incorrectly, additional spatial co- 
ordinates of the object (2) are determined on a basis of the projection data and one of 
the object images (8, 9) by searching for corresponding image points (Si, S r ) in the 
object images (8, 9) (see Two Complementary Stereo Matching Schemes, column 7 line 
15 - column 8 line 48) and a subsequent triangulation (see triangulation 
algorithm/principle, Abstract, column 3 lines 40-41 and Fig. 1 ; see also active 
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triangulation, column 2 lines 9-50) using a known distance between the two cameras (6) 
(see "the length of "base line", B, between two cameras is known", column 4 lines 35- 
37). 

Further, Geng teaches the pattern (4) contains encoded projection data (see 
"simple and elegant way to encode", column 4 lines 52-56; see also encodes, column 7 
lines 34-38). Geng differs from the claimed invention in that it does not explicitly teach 
redundant encoded projection data and restricting the search for corresponding image 
points to problem areas in which an evaluation of the pattern images only produce an 
erroneous result. 

Pettersen et al. teaches a method and system, using cameras, for determination 
of relative position and/or orientation of objects by projecting a pattern (Abstract, [0001]- 
[0008] and Figs. 2, 5 & 6). Further, Pettersen et al. teaches "The method of calculation 
is bases on minimizing errors (least squares method) such that the redundant 
information is used" (i.e. redundant encoded projection data and restricting the search 
for corresponding image points to problem areas in which an evaluation of the pattern 
images only produce an erroneous result, [0025] and Fig. 2]). Since Pettersen et al. 
teaches the redundant data is used to minimize errors, it would have been obvious to 
one of ordinary skill in the art to search the redundant information for corresponding 
image points to problem areas in which an evaluation of the pattern images produces 
an erroneous result in order to correct the result, thus minimizing errors. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Pettersen et al. with Geng 
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because Pettersen et al. teaches the principle of coordinate determination from the 
imaging of a common point in two or more cameras and a means for coordinate 
measurement that gives full flexibility with respect to the number of cameras and other 
features ([0009]-[0014] and [0021]-[0022]), thereby improving the flexibility of the 
system. 

Regarding claim 11, Geng teaches the limitations of claim 10 as indicated 
above. Further, Geng teaches: 

The method as claimed in claim 10, wherein corresponding pixels (Si, S r ) are 
searched for along epipolar lines (16, 17) (see epipolar line, column 8 lines 20-48 and 
Fig. 5). 

Regarding claim 12, Geng and Pettersen et al. teach the limitations of claim 10 
as indicated above. Further, Geng teaches: 

3. The method as claimed in claim 1 0, wherein epipolar lines (1 6, 1 7) pass through 
a plurality of marks of the pattern (4) (see epipolar line, column 8 lines 20-48 and Fig. 
5). 

Regarding claim 13, Geng and Pettersen et al. teach the limitations of claim 1 as 
indicated above. Further, Geng teaches: 

The device according to claim 1 , wherein the pattern (4) is composed of stripes 
that are projected consecutively onto the object (2), with stripe widths of the pattern 
varying (see "producing a continuous spatially varying wavelength (rainbow-like color) 
illumination of the scene", column 3 lines 34-36; see also "the LVWF is a rectangular 
optical glass plate coated with gradually varying wavelengths of colors", column 6 lines 
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1-3; see also "popular structured light techniques include light stripe method... active 
triangulation a beam of light is used to form a bright stripe on an object's surface", 
column 2 lines 8-17). 

Regarding claim 14, Geng and Pettersen et al. teach the limitations of claim 1 as 
indicated above. Further, Geng teaches: 

The device according to claim 1 , wherein the two object images (8, 9) yield three- 
dimensional data (see "the proposed Rainbow Stereo 3D camera exploits a projected 
rainbow color pattern as unique landmarks of each pixel for correspondence 
registration... A simple and efficient 3D triangulation algorithm can be formulated to 
generate full frames of 3D images in high speed", column 3 lines 44-54). 

Regarding claim 17, Geng and Pettersen et al. teach the limitations of claim 10 
as indicated above. Further, Geng teaches: 

The method according to claim 10, wherein the pattern (4) is composed of stripes 
that are projected consecutively onto the object (2), with stripe widths of the pattern 
varying (see "producing a continuous spatially varying wavelength (rainbow-like color) 
illumination of the scene", column 3 lines 34-36; see also "the LVWF is a rectangular 
optical glass plate coated with gradually varying wavelengths of colors", column 6 lines 
1-3; see also "popular structured light techniques include light stripe method... active 
triangulation a beam of light is used to form a bright stripe on an object's surface", 
column 2 lines 8-17). 

Regarding claim 18, Geng and Pettersen et al. teach the limitations of claim 10 
as indicated above. Further, Geng teaches: 
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The method according to claim 10, wherein the two object images (8, 9) yield 
three-dimensional data (see "the proposed Rainbow Stereo 3D camera exploits a 
projected rainbow color pattern as unique landmarks of each pixel for correspondence 
registration... A simple and efficient 3D triangulation algorithm can be formulated to 
generate full frames of 3D images in high speed", column 3 lines 44-54). 

Response to Arguments 
4. Applicant's arguments filed December 28, 201 0 have been fully considered but 
they are not persuasive. 

Applicant argues: 

GENG merely uses 1 :1 "camera-camera-triangulation"approach. This can be seen in Figures 1 
and 2 of GENG, which are reproduced below. . . 

GENG teaches: "the rainbow stereo 3D camera is based on a novel approach to producing a 
continuous spatially varying wavelength (rainbow like color) illumination of the scene. Two 
color CCD cameras or two locations of a camera separated by a baseline distance are used to 
capture stereo pair images of the scene at the camera's frame rate. The 3D depth values are 
calculated using triangulation principle by finding pixels corresponding to a common color feature 
in both images. "Column 3 lines 34-42 and Figures 1-2. 

The Office Action does not use a constant definition for the term "baseline distance" throughout. 
According to the above recitation a "baseline distance" is a distance between two camera 
locations. 

The Examiner respectfully disagrees and asserts that the interpretation of 
"baseline distance" is consistent with the teachings of Geng. Geng teaches "In the 
most straightforward form of active triangulation a beam of light is used to form a bright 
stripe on an object's surface and a camera displaced in a known distance (base line) 
from the light source views the scene" (emphasis added, column 2 lines 13-17). In 
this case, Geng teaches that the base line is the known distance between a camera 
and a light source e.g. a projector and thus Geng teaches "camera-projector- 
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triangulation". By Applicant's own admission (see pages 12-13 of remarks filed 
December 28, 2010), Geng teaches "camera-camera-triangulation". It is further noted 
that Geng discloses ""the length of "base line", B, between two cameras is known" (i.e. 
"camera-camera-triangulation", column 4 lines 35-37). The Examiner maintains that 
Geng and Pettersen et al. teaches or suggests the limitations of the claims as indicated 
above. 

Applicant argues: 

Moreover, GENG does not disclose determining additional spatial co-ordinates by a triangulation 
method in problem areas, in which an evaluation of the redundant data of the object image 
produces an erroneous result, since GENG does not evaluate redundant data of the object 
images, but computes a variance of intensity over a window area surrounding each pixel of the 
object image (see GENG at column 10, lines 8 to 1 1). 

Initially it is noted that Geng et al. was not relied upon to teach this limitation. It is 
further noted that Geng teaches searching for corresponding image points (see "the 
colors of corresponding pixel in searching space is unique and distinguishable", column 
7 lines38-39 and "the search of matching points requires less complex computations", 
column 8 lines 12-13). 

Applicant argues: 

The use of redundant encoded projection data is also not disclosed in PETTERSEN et al. In 
addition, PETTERSEN et al. do not disclose the projection of any pattern at all. 

Pettersen et al. teaches the projection of "light spots" (see Abstract and [0004]). 
One of ordinary skill in the art would readily recognize the projection of light spots as a 
projected pattern (see, for example, "the projection of a pattern of light such as an array 
of dots, stripes, or a grid simultaneously onto the scene", emphasis added, as 
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disclosed in Geng, column 2 lines 26-28), therefore Pettersen et al. teaches the 
projection of a pattern. Further, Pettersen et al. teaches determination of spatial 
coordinates wherein "The calculation requires the distance of at least one distance 
between two points to be known to give correct scale information to the system of 
equations. The method of calculations is base on minimizing errors. ..such that 
redundant information is used" (i.e. redundant encoded projection data, [0024]-[0025]). 
The Examiner maintains that Geng and Pettersen et al. teaches or suggests the 
limitations of the claims as indicated above. 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

Forster et al. in US Publication 2006/0098212 (see IDS filed November 6, 2006 
item no. 1) teaches three-dimensional detection of objects wherein "a known position of 
the projector and the camera, the three-dimensional data of an object point on the 
surface of the object to be detected can be calculated" (i.e. camera-projector- 
triangulation, [0006] and [0029]) and "the projection coordinates are encoded in the 
color pattern with the aid of a redundant code... a projector which projects a redundantly 
coded color pattern onto the object to be detected" (i.e. redundant encoded projection 
data, [0005]-[0006]). Further Forester et al. teaches restricting the search for 
corresponding image points to problem areas in which an evaluation of the pattern 
images only produce an erroneous result (see "Errors attributable to changes in the 
coloring of the object to be detected can be eliminated by these two methods", [0018]; 
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see also "...requirements for the encoding of the color pattern allow errors in decoding 
to be reliably detected. Decoding is undertaken here by the analysis unit... checking the 
size of the color change and the correlation of the color changes. . . Finally the color 
changes are checked for matches with the encoded codewords of the color change and 
the projection data assigned to a point of the recorded image", [0020]-[0022]; see also 
[0030]). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Forster et al. with Geng 
because Forster et al. teaches "a method for three-dimensional detection of objects 
which is not adversely affected either by the coloration or by indentations in the object to 
be detected" ([0009]) and One of ordinary skill in the art would have been capable of 
applying this known technique to a known method that was ready for improvement and 
the results would have been predictable to one of ordinary skill in the art. 
6. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mi'schita' Henson whose telephone number is (571) 
270-3944. The examiner can normally be reached on Monday - Thursday 7:30 a.m. - 
4:00 p.m. EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Drew Dunn can be reached on (571 ) 272-231 2. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 

you have questions on access to the Private PAIR system, contact the Electronic 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 

USPTO Customer Service Representative or access to the automated information 

system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

02/26/2011 
/Mi'schita' Henson/ 
Examiner, Art Unit 2857 

Drew A. Dunn 
/Drew A. Dunn/ 
Supervisory Patent Examiner, Art Unit 2857 
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